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(8) Claims Appendix 

Claim 1 (Previously presented): A natural language 
interface control system for operating a plurality of devices comprising: 
a 3 dimensional microphone array; 

a feature extraction module coupled to the first microphone array; 

a speech recognition module coupled to the feature extraction module, 
wherein the speech recognition module utilizes hidden Markov models and can switch 
between different acoustic models and different grammars, wherein at least one of the 
different acoustic models and at least one of the different grammars is downloaded over a 
network; 

a natural language interface module coupled to the speech recognition module; 

and 

a device interface coupled to the natural language interface module, wherein 
the natural language interface module is for operating a plurality of devices of one or more 
types that are coupled to the device interface based upon non-prompted, open-ended natural 
language requests from a user; 

wherein the natural language interface module abstracts each of the plurality 
of devices into a respective one of the different grammars and a respective one of a plurality 
of lexica corresponding to each of the plurality of devices. 

Claim 2 (Original): The system of Claim 1 further 
comprising the plurality of devices coupled to the natural language interface module. 

Claim 3 (Original): The system of Claim 1 wherein the speech recognition 
module utilizes an N gram grammar. 

Claim 4 (Original): The system of Claim 1 wherein the natural language 
interface module utilizes a probabilistic context free grammar. 
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Claim 5 (Previously presented): The system of Claim 1 wherein the 
microphone array comprises said 3 dimensional microphone array further comprising a 
planar microphone array and at least one linear microphone array located in a different plane 
in space. 

Claim 6 (Previously presented): A natural language interface control system 
for operating a plurality of devices comprising: 

a 3 dimensional microphone array; 

a feature extraction module coupled to the first microphone array; 

a speech recognition module coupled to the feature extraction module, 
wherein the speech recognition module utilizes hidden Markov models and can switch 
between different acoustic models and different grammars; 

a natural language interface module coupled to the speech recognition module; 

and 

a device interface coupled to the natural language interface module, wherein 
the natural language interface module is for operating a plurality of devices of one or more 
types that are coupled to the device interface based upon non-prompted, open-ended natural 
language requests from a user; 

wherein the natural language interface abstracts each of the plurality of 
devices into a respective one of a plurality of grammars and a respective one of a plurality of 
lexica corresponding to each of the plurality of devices. 

Claim 7 (Previously presented): A natural language interface control system 
for operating a plurality of devices comprising: 

a 3 dimensional microphone array; 

a feature extraction module coupled to the first microphone array; 

a speech recognition module coupled to the feature extraction module, 
wherein the speech recognition module utilizes hidden Markov models and can switch 
between different acoustic models and different grammars; 
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a natural language interface module coupled to the speech recognition module; 

and 

a device interface coupled to the natural language interface module, wherein 
the natural language interface module is for operating a plurality of devices of one or more 
types that are coupled to the device interface based upon non-prompted, open-ended natural 
language requests from a user; 

wherein the natural language interface module searches for the non-prompted, 
open-ended user requests upon the receipt and recognition of an attention word. 

Claim 8 (Previously presented): A natural language interface control system 
for operating a plurality of devices comprising: 

a 3 dimensional microphone array; 

a feature extraction module coupled to the first microphone array; 

a speech recognition module coupled to the feature extraction module, 
wherein the speech recognition module utilizes hidden Markov models and can switch 
between different acoustic models and different grammars; 

a natural language interface module coupled to the speech recognition module; 

and 

a device interface coupled to the natural language interface module, wherein 
the natural language interface module is for operating a plurality of devices of one or more 
types that are coupled to the device interface based upon non-prompted, open-ended natural 
language requests from a user; 

wherein the natural language interface module context switches grammars, 
acoustic models, and lexica upon receipt and recognition of an attention word. 

Claim 9 (Previously presented): A natural language interface control system 
for operating a plurality of devices comprising: 

a 3 dimensional microphone array; 

a feature extraction module coupled to the first microphone array; 
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a speech recognition module coupled to the feature extraction module, 
wherein the speech recognition module utilizes hidden Markov models and can switch 
between different acoustic models and different grammars; 

a natural language interface module coupled to the speech recognition module; 

a device interface coupled to the natural language interface module, wherein 
the natural language interface module is for operating a plurality of devices of one or more 
types that are coupled to the device interface based upon non-prompted, open-ended natural 
language requests from a user; and 

a grammar module for storing different grammars for each of the plurality of 

devices. 

Claim 10 (Previously presented): A natural language interface control system 
for operating a plurality of devices comprising: 

a 3 dimensional microphone array; 

a feature extraction module coupled to the first microphone array; 

a speech recognition module coupled to the feature extraction module, 
wherein the speech recognition module utilizes hidden Markov models and can switch 
between different acoustic models and different grammars; 

a natural language interface module coupled to the speech recognition module; 

a device interface coupled to the natural language interface module, wherein 
the natural language interface module is for operating a plurality of devices of one or more 
types that are coupled to the device interface based upon non-prompted, open-ended natural 
language requests from a user; and 

an acoustic model module for storing different acoustic models for each of the 
plurality of devices. 

Claim 1 1 (Original): The system of Claim 1 wherein the device interface 
comprises a wireless device interface. 
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Claim 12 (Original): The system of Claim 1 further comprising an external 
network interface coupled to the natural language interface control system. 

Claim 13 (Original): The system of Claim 1 further comprising a remote unit 
containing a first microphone array, the feature extraction module, the speech recognition 
module, and the natural language interface module, wherein said 3 dimensional microphone 
array includes the first microphone array. 

Claim 14 (Original): The system of Claim 13 further 
comprising a base unit coupled to the remote unit. 

Claim 15 (Previously presented): The system of Claim 14 wherein the base 
unit includes a second microphone array, wherein said 3 dimensional microphone array 
includes the second microphone array. 

Claim 16 (Previously presented): The system of Claim 15 wherein the first 
microphone array and the second microphone array implement said 3 dimensional 
microphone array. 

Claim 17 (Previously presented): A method of speech recognition comprising: 
searching for an attention word based on a first context including a first set of 

models, grammars, and lexica; and 

switching, upon finding the attention word, to a second context to search for 

an open-ended user request, wherein the second context includes a second set of models, 

grammars, and lexicons. 

Claims 18-25 (Canceled) 
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Claim 26 (Previously presented): A natural language interface control system 
for operating a plurality of devices comprising: 
a first microphone; 

a feature extraction module coupled to the first microphone; 

a speech recognition module coupled to the feature extraction module; 

a natural language interface module coupled to the speech recognition module; 

a device interface coupled to the natural language interface module, wherein 
the natural language interface module is for operating a plurality of devices of one or more 
types that are coupled to the device interface based upon non-prompted, open-ended natural 
language requests from a user; and 

an external network interface coupled to the natural language interface control 

system; 

wherein the natural language interface abstracts each of the plurality of 
devices into a respective one of a plurality of grammars and a respective one of a plurality of 
lexica corresponding to each of the plurality of devices. 

Claim 27 (Previously presented): The system of Claim 26 further comprising 
the plurality of devices coupled to the natural language interface module. 

Claim 28 (Previously presented): The system of Claim 26 wherein the speech 
recognition module utilizes an N gram grammar. 

Claim 29 (Previously presented): The system of Claim 26 wherein the natural 
language interface module utilizes a probabilistic context free grammar. 

Claim 30 (Previously presented): The system of Claim 26 wherein the 
microphone array comprises a 3 dimensional microphone array comprising a planar 
microphone array and at least one linear microphone array located in a different plane in 
space. 



Page 19 of 22 



Application No. 09/692,846 

Notice of Appeal dated January 18, 2007 

Claim 31 (Canceled) 

Claim 32 (Previously presented): The system of Claim 26 wherein the natural 
language interface module searches for the non-prompted, open-ended user requests upon the 
receipt and recognition of an attention word. 

Claim 33 (Previously presented): The system of Claim 26 wherein the natural 
language interface module context switches grammars, acoustic models, and lexica upon 
receipt and recognition of an attention word. 

Claim 34 (Previously presented): The system of Claim 26 further comprising a 
grammar module for storing different grammars for each of the plurality of devices. 

Claim 35 (Previously presented): The system of Claim 26 further comprising 
an acoustic model module for storing different acoustic models for each of the plurality of 
devices. 

Claim 36 (Previously presented): The system of Claim 26 wherein the device 
interface comprises a wireless device interface. 

Claim 37 (Previously presented): The system of Claim 26 further comprising a 
remote unit containing the first microphone array, the feature extraction module, the speech 
recognition module, and the natural language interface module. 

Claim 38 (Previously presented): The system of Claim 37 further comprising a 
base unit coupled to the remote unit. 

Claim 39 (Previously presented): The system of Claim 38 wherein the base 
unit includes a second microphone array. 
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Claim 40 (Previously presented): The system of Claim 39 wherein the first 
microphone comprises a first microphone array, and said first microphone array and the 
second microphone array implement a 3 dimensional microphone array. 

Claim 41 (Previously presented): The system of Claim 26 further comprising a 
central database coupled to said external network interface, said central database including at 
least one of grammars; speech models; device abstractions; programming information; and 
lexica. 

Claim 42 (Previously presented): The system of Claim 41 wherein said central 
database is coupled to said external network interface through an external network. 

Claim 43 (Previously presented): The system of Claim 42 further comprising: 
a remote server coupled to said external network and to 
said central database. 

Claim 44 (Previously presented): The system of Claim 42 further comprising: 

another natural language interface control system; and 
another external network interface coupled to said other natural language interface control 
system, and to said external network. 

Claims 45-56 (Canceled) 
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In view of the foregoing, it is submitted that the application is in condition for 
allowance which is respectfully requested. The Commissioner is hereby authorized to charge 
any additional fees which may be required to Deposit Account No. 06-1 135. 



Suite 1600 

120 South LaSalle 

Chicago, Illinois 60603-3406 

Telephone: (312)577-7000 

Facsimile: (312)577-7007 



Respectfully submitted, 



FITCH, EVEN, TABIN & FLANNERY 




Timothy Ry^aumann 
Registration No. 40,502 
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